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Motion Compensation 



5 The present invention relates to the field of image processing, for 

example in medical applications. In particular, the present invention relates to a method 
of motion compensation in a projection data set of an object of interest, to data 
processing devices and to respective computer programs. 

Motion is one of the most critical sources of artifacts in positron 

10 emission tomography (PET), single photon emission computed tomography (SPECT) 
and computed tomography (CT), particularly in cardiac helical cone-beam CT. 

Conventionally, the object of interest needs to be fixed both in position 
and direction during the measurement period. Such stationary posture may be very 
pamful to a human body or an animal. Also, a significantly long scan time may lead to 

15 significant losses of resolution due to patient or organ motion, in particular for heart 
and thorax imaging where heart and breathing motion is present during the data 
acquisition. Also, artifacts due to a motion or deformation of the object of interest 
appear in the image obtained by image reconstmction. 

In cardiac helical cone-beam CT data are often acquired using a low 

20 pitch helical scan and an electro-cardiogram (ECG) is recorded simultaneously. For 
reconstruction, a certain position P within the cardiac cycle is selected and only 
projection data in a temporal gating window T-[p-A;p+A] around this position are used. 
It is assumed that the heart did not move within the window T. However, this is only 
true approximately, leading to blurred images or images comprising motion artifacts. 

25 Various motion compensation techniques are known in the art, which use 

a plurality of disjunct or non-overlapping gating windows in order to allow for a motion 
detection and a following compensation of the motion. 



30 



It is an object of the present invention to provide for improved image 

quality. 
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According to an exemplary embodiment of the present invention as set 
forth in claim 1, the above object maybe solved by a method of motion compensation in 
a projection data set of an object of interest. According to this exemplary embodiment 
of the present invention, a first gating window comprising first projection data and a 
5 second gating window comprising second projection data are selected. After that, a 

motion of the object of interest on the basis of the projection data of the first and second 
gating windows is estimated and a motion compensated reconstruction on the basis of 
the motion estimation is performed, wherein the first and second gating windows at 
least partially overlap on a time axis. 

10 In other words, a plurality of gating windows comprising projection data 

are used for detecting motion inside the objects of interest. Advantageously, the gating 
windows are not disjunct or timely separated but the different gating windows do at 
least p£irtially overlap. The overlap may allow for a reduction of projection data 
required for motion detection and compensation. 

1 5 According to another exemplary embodiment of the present invention as 

set forth in claim 2, the estimation of motion comprises the step of generating a motion 
map for the object of interest on the basis of the projection data of the first and second 
gating windows, wherein the motion compensated reconstraction is performed on the 
basis of the motion map. 

20 Advantageously, this may allow for an exact motion estimation for the 

entire object of interest or, if desired, for only parts of the object of interest. 

According to another exemplary embodiment of the present invention as 
set forth in claim 3, the selection of the first gating window and the second gating 
window is performed by the selection of a first phase point and a determination of the 

25 first gating window comprising first projection data, wherein the first gating window 
corresponds to the first phase point. Furthermore, a selection of a second phase point on 
the basis of the first phase point is performed and a second gating window comprising 
second projection data is determined, wherein the second gating window corresponds to 
the second phase point. 

30 Advantageously, according to this exemplary embodiment of the present 

invention, the first phase point may be selected on the basis of the heart cycle of a 
patient, allowing for a minimization of motion artifacts inside the gating window, since 
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the first phase point may be selected at a point in time where motion of the heart is 
minimal. Furthermore, according to this exemplary embodiment of the present 
invention, the width of the first gating window and the width of the second gating 
window may be selected on the basis of the individual heart cycle, allowing for a 
5 minimization of projection data used for reconstmction of the image. 

According to an other exemplary embodiment of the present invention as 
set forth in claim 4, the generation of the motion map is performed by reconstructing a 
first image on the basis of the first projecting data and reconstructing a second image on 
the basis of the second projection data. After that, motion of an average position for 

10 each point of interest on the basis of the projection data of the first and second gating 
windows is determined, resulting in the motion map. 

Advantageously, according to this exemplary embodiment of the present 
invention, motion is determined by analyzing reconstmcted images basing on projection 
data firom different time intervals or overlapping gating windows. 

1 5 According to an other exemplary embodiment of the present invention as 

set forth in claim 5, the motion compensated reconstruction on the basis of the motion 
map comprises the steps of forward projecting the first image by using the motion map, 
resulting in forward projected first image data. After that, a difference between the forward 
projected first image data and the measured projection data is determined and a back- 

20 projection of the difference by using the motion map is performed. After that, the first 
image is updated on the basis of the back-projected difference. 

Advantageously, the above method takes a motion or deformation of the 
object of interest into account. Furthermore, it may still allow to maximize a likelihood 
function. Overall, according to this exemplary embodiment of the present invention, 

25 even in the presence of motion or motion artifacts in the object of interest, a proper 
reconstruction may be realized, yielding in a sharp image with a high signal-to-noise 
ratio. 

Another exemplary embodiment of the present invention as set forth in 
claim 6 provides for a method of motion compensation, wherein the motion 
30 compensated reconstruction is performed iteratively until an end criterion has been 
fulfilled. Advantageously, this may allow for improved image quality. 



wo 2005/088543 



PCT/IB2005/050655 



4 

According to another exemplary embodiment of the present invention as 
set forth in claim 7, the second phase point is negatively shifted on the time axis with 
respect to llie first phase point. Advantageously, the amount of the shifts may be set 
depending on individual parameters of the object of interest, e.g. the amount of motion 
5 inside the object of interest, which may be a heart of a patient. 

According to another exemplary embodiment of the present invention as 
set forth in claim 8, the projection data set is acquired by means of a source of 
electromagnetic radiation generating a beam and by means of a radiation detector 
detecting the beam, wherein the source of electromagnetic radiation is a polychromatic 

10 x-ray source, which moves along a helical path around the object of interest. 

Furthermore, the beam has one of a cone-beam geometry and a fan-beam geometry. 

The application of a polychromatic x-ray source is advantageous, since 
polychromatic x-rays are easy to generate and provide a good image resolution. It 
should be noted that, since the geometry of the CT scanner system may be of different 

15 designs, such as, for example, cone-beam or fan-beam geometry, a method for an 
exemplary embodiment of the present invention may be applied to a plurality of 
different scanner systems and may not be limited to CT scanner systems, but may be 
applied to PET (positron emission tomography) scanner systems or SPECT (single 
photon emission computed tomography) scanner systems. 

20 Another exemplary embodiment of the present invention as set forth in 

claim 9 provides for a data processing device for reconstructing an image from 
projection data, which takes into account a motion and/or deformation of the object of 
interest by performing a motion compensated reconstruction of the image on the basis 
of the projection data, wherein the motion compensated reconstruction is performed for 

25 the object of interest on the basis of the motion estimation, wherein the first, second and 
third gating windows do at least partially overlap on a time axis. 

According to another exemplary embodiment of the present invention as 
set forth in claim 10, the estimation of motion performed by the data processing device 
comprises the step of generating a motion map for the object of interest on the basis of 

30 the projection data of the first and second gating windows, wherein the motion 
compensated reconstruction is performed on the basis of the motion map. 

According to another exemplary embodiment of the present invention as 
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set forth in claim 1 1, a CT scanner system is provided, comprising a memory for storing 
a data set and a data processor for performing motion compensation in a projection data 
set of an object of interest according to an exemplary embodiment of a method 
according to the present invention. 
5 The present invention also relates to a computer program, which may, for 

example, be executed on a processor, such as an image processor. Such a computer 
program may be part of, for example, a CT scanner system. The computer program, 
according to an exemplary embodiment of the present invention, is set forth in claim 
12. The computer program may be preferably loaded into working memories of data 

10 processors. The data processors are thus equipped to carry out exemplary embodiments 
of the methods of the present invention. The computer program may be written in any 
suitable programming language, for example, in C+-i- and may be stored on a computer 
readable medium, such as a CD-ROM. Also, these computer programs may be available 
from a network, such as the Worldwide Web, from which they may be downloaded into 

1 5 image processing units or processors, or any suitable computers. 

It may be seen as the gist of an exemplary embodiment of the present 
invention that motion in a projection data set of an object of interest is detected by 
using a plurality of at least partially overlapping gating windows comprising projection 
data and that motion inside the gating windows is compensated for by reconstructing 

20 only the projection data inside that least partially overlapping gating windows. No 
reconstruction of projection data outside the gating windows has to be performed. 
Advantageously, according to an exemplary embodiment of the present invention, the 
gating windows are only slightly shifted with respect to each other, resulting in a large 
overlap and therefore comprise almost the same projection data. 

25 These and other aspects of the present invention will be come apparent 

from and will be elucidated with reference to the embodiment described hereinafter. 

Exemplary embodiments of the present invention will be described in the 
following, with reference to the following drawings: 

30 

Fig. 1 shows a simplified schematic representation of an embodiment of 
a computer tomography (CT) scanner according to the present invention. 
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Fig. 2 shows a schematic representation of first, second and third gating 
windows T.i, To and Ti, respectively. 

Fig. 3 shows reconstructed images of a heart at the first, the second and 
the third phase point p.i, po and pi, respectively. 
5 Fig. 4 shows the average position of a point of interest at the three phase 

points p-i, po and pi. 

Fig. 5 shows a flow-chart of an exemplary embodiment of a method 
according to the present invention. 

Fig. 6 shows a flow-chart of an iterative motion compensated 
10 reconstruction algorithm. 

Fig. 7 shows an exemplary embodiment of an image processing device 
according to the present invention for executing an exemplary 
embodiment of a method in accordance with the present invention. 



15 

Fig. 1 shows a simplified schematic representation of an exemplary 
embodiment of a CT (computed tomography) scanner system according to the present 
invention. With reference to this exemplary embodiment, the present invention will be 
described for the application in medical imaging. However, it should be noted that the 
20 present invention is not limited to the application in the field of medical imaging, but 
may be used in applications such as baggage inspection to detect hazardous materials, 
such as explosives, in items of baggage or other industrial applications, such as material 
testing. 

The scanner depicted in Fig. 1 is a cone beam CT scanner. The CT 
25 scanner depicted in Fig. 1 comprises a gantry 1 , which is rotatable around a rotational 
axis 2. The gantry is driven by means of a motor 3. Reference numeral 4 designates a 
source of radiation such as an x-ray source, which, according to an aspect of the present 
invention, emits a polychromatic radiation. 

Reference numeral 5 designates an aperture system, which forms the 
30 radiation beam emitted from the radiation source to a cone shaped radiation beam 6. 

The cone beam 6 is directed such that it penetrates an object of interest 7 
arranged in the center of the gantry 1, i.e. ia an examination region of the CT scaimer 
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and impinges onto the detector 8. As may be taken from Fig. 1, the detector 8 is 
arranged on the gantry 1 opposite the source of radiation 4, such that the surface of the 
detector 8 is covered by the cone beam 6. The detector 8 depicted in Fig. 1 comprises a 
plurality of detector elements. 
5 During a scan of the object of interest 7, the source of radiation 4, the 

aperture system 5 and detector 8 are rotated along gantry 1 in the direction indicated by 
arrow 16. For rotation of the gantry 1 with the source of radiation 4, the aperture system 
5 and the detector 8, the motor 3 is connected to a motor control unit 17, which is 
connected to a calculation unit 1 8. 

10 In Fig. 1, the object of interest is disposed on a conveyor belt 19. During 

the scan of the object of interest 7, while the gantry 1 rotates around the patient 7, the 
conveyor belt 19 displaces the object of interest 7 along a direction parallel to the 
rotational axis 2 of the gantry 1. By this, the object of interest 7 is scanned along a 
helical scan path. The conveyor belt 19 may also be stopped during the scans. Instead of 

15 providing a conveyor belt 19, for example, in medical applications, where the object of 
interest 7 is a patient, a movable table is used. However, it should be noted that in all of 
the described cases it is also possible to perform a circular scan, where there is no 
displacement in a direction parallel to the rotational axis 2, but only the rotation of the 
gantry 1 around the rotational axis 2. 

20 The detector 8 is coimected to the calculation unit 18. The calculation 

unit 18 receives the detection residt, i.e. the read-outs from the detector element of the 
detector 8, and determines a scanning result on the basis of the read-outs. The detector 
elements of the detector 8 may be adapted to measure the attenuation caused to the cone 
beam 6 by the object of interest. Furthermore, the calculation unit 18 communicates 

25 with the motor control tinit 17 in order to coordinate the movement of the gantry 1 with 
motor 3 and 20 or with the conveyor belt 19. 

The calculation unit 1 8 may be adapted for reconstructing an image from 
read-outs of the detector 8. The image generated by the calculation unit 18 may be 
output to a display (not shown in Fig. 1) via an interface 22. 

30 The calculation unit 18 which may be realized by a data processor may 

also be adapted to perform a motion compensation in the image based on the read-outs 
from the detector elements of the detector 8. According to an aspect of the present 
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invention, this motion correction or compensation may be performed by selecting a first 
gating window, a second gating window and a third gating window comprising first, 
second and third projection data, and generating a motion map for all points of interest 
on the basis of the projection data of the first, second and third gating windows. After 
5 that, a motion compensated reconstruction may be performed on the basis of the motion 
map. It should be noted, that the first, second and third gating windows at least partially 
overlap. 

Furthermore, it should be understood that, although an exemplary 
embodiment of the present invention uses three gating windows which are shifted with 

10 respect to each other (in the meaning that the second gating window starts at a point in 
time which is located before the start of the first gating window and that the third gating 
window starts after the start of the first gating window), also the usage of two timely 
shifted gating windows is possible; also it is possible to use four or five or any other 
bigger number of gating windows for motion estimation and motion map generation 

1 5 according to the present invention. 

Furthermore, as may be taken firom figure 1, the calculation unit 18 may 
be connected to allow speaker 21 to, for example, automatically output an alarm. 

Fig. 2 shows a schematic representation of three different gating 
windows T.i, To and Ti at three different corresponding phase points p.i, po and pi. 

20 According to an exemplary embodiment of the methods of the present invention, 
motion within the window To is estimated and the motion estimation information is 
used for improving the image quality. 

As maybe seen firom Fig. 2, the three gating windows overlap in a 
temporal sense and are positioned between the R peaks of the heart beat cycle. The R- 

25 peak is the most prominent peak in the electrocardiogram (ECG), which indicates the 
depolarization of the heart muscle. Since the contraction of the muscle follows the 
depolarization, the R-peak is seen as a reference point in the heart cycle. In order to 
compensate for variations in the duration of the heart cycle, phase points are typically 
specified as the relative distance between two succeeding R-peaks, e.g. 30%RR. 

30 Advantageously, the three gating windows almost overlap completely and are only 
slightly shifted with respect to each other, allowing for a usage of almost identical 
projection data for each gating window. Furthermore, the three phase points p.i, po and 
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pi are positioned at a point in time of the heart beat cycle, where the movement of the 
heart is minimal. 

Fig. 3 shows reconstructed images of a heart at three different phase 
points or target phases p.i, po and pi. Reconstructed image 32 shows tihie heart at the 
5 target phase po which is located at 30% RR. Reconstructed image 31 shows the heart at 
a phase p.i located at 25% RR and reconstructed image 33 shows the heart at a phase pi 
located at 35% RR. Reconstructed images 31, 32 and 33 axe images of the entire heart, 
wherein corresponding reconstructed images 34, 35 and 36 are enlargements of a 
specific section of images 31, 32 and 33, where a coronary artery transverses the slice. 
10 The arrow shown in the images always point at the same object point, i. e. the coronary 
artery. 



As maybe seen from Fig. 3, the coronary artery moves from the left to 

15 the right, which leads to a smearing. A standard motion estimation technique, like the 
Block Matching Algorithm, which is described in T. Schaffier, V. Rasche, I.C. Carlsen, 
"Motion Compensated Projection Reconstruction", Magnetic Resonance in Medicine 
41: 954-963 (1999), which is hereby incorporated by reference, may be used to 
determine the motion of the average position. 

20 If the temporal distance of the two ftirther phase points p-i, pi from the 

target phase point po is small, then it can be assumed that the velocity changes only 
slightly within the three gating windows and a linear or quadratic model may be used to 
inter- and extrapolate the average position throughout the entire gating window To- This 
is illustrated in Fig. 4, which shows the x-position of a certain grid point, e.g. the 

25 coronary artery indicated in Fig. 3. The motion estimation provides the position and the 
three time points or phase points p.i, po and pi, resulting in a motion map. The motion 
map may be calculated for all points of interest and for motions in x, y, and z-direction. 
Finally, the motion map may be used to perform a motion compensated reconstruction. 

The motion map or motion field describes a motion and/or deformation 

30 of a point of interest or object of interest at a certain point of time. 

Fig. 5 shows a flow-chart of an exemplary embodiment of a method 
according to the present invention. After the start at step SO, the projection data are 
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acquired (measured projection data) in step SI. This may, for example, be done by 
using a suitable CT scanner or by reading the projection data from a storage. In a 
subsequent step S2, a first phase point po is selected. The selection of the phase point 
may be performed manually via a user or automatically from the software side. Then, in 
5 step S3, a first gating window To = [po-A;po+A] is determined on the basis of the first 
phase point. In this corresponding cardiac gating window To may either be specified by 
a user or determined automatically. After that, an image is reconstructed using a cardiac 
CT algorithm, which uses gating data, resulting in a reconstructed first image (step S4). 
The structures in this image represent the average position of the structures within the 

10 gating window To- In a ftirther step (S5), two more phase points p-i and pi are 

determined and in step S6 corresponding second and third gating windows T.i and Ti 
are determined on the basis of the second and third phase points, respectively. For 
example, the second gating window may be determined byT-i=[p_i-A;p.i+A] and the 
third gating window may be determined by Ti=[pi-A;pi+A]. According to this 

15 exemplary embodiment of the present invention, the second phase point is negatively 
shifted with respect to the first phase point and the third phase point is positively shifted 
with respect to the first phase point, meaning that p-i<po<pi. It should be noted that, 
although in this exemplary embodiment of the present invention the three gating 
windows have the same size on the time axis, in other exemplary embodiments they 

20 may have different sizes. 

After that, in step S7, a reconstmction of second and third images is 
performed using the same procedure as for the reconstruction of the first image. Then, 
in step S8, motion of an average position of an object point of interest or an object of 
interest is performed, e.g. by using a motion estimation technique like a block matching 

25 algorithm. Since the temporal difference between the target phase point and the second 
and third phase points is small, it can be assumed that the velocity of the point of 
interest changes only slightly within the three gating windows and therefore a linear or 
quadratic model may be used to inter- or extrapolate the average position of the point of 
interest throughout the entire gating window To, as indicated in Fig. 4. 

30 After the determination of motion of the average position of a point of 

interest, a motion map for each point of interest and for motion in x, y, and z-direction 
is generated in step S9. This motion map or motion field describes the motion of each 
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point of interest, for example relative to a chosen reference image. After that, in step 
S IO, a motion compensated reconstruction algorithm may be performed on the basis of 
the motion map, resulting in a motion compensated reconstruction of the image and 
therefore in an improvement of image quality. The method ends in step SI Ob. 
5 Fig. 6 shows a flow-chart of an iterative motion compensated 

reconstruction algorithm starting with step SI 1, which may be the generation of a 
motion map. After that, in step SI 2, a forward projecting of the first image using the 
motion map is performed, resulting in forward projected first image data. 

The first image may, for example, be a homogeneous distribution, a 
10 filtered back-projection of the measured projection data or a simple back-projection of 
the measured projection data. 

In step S14 a difference between the forward projected first image 
dataand the measured projection data is determined. In other words, a comparison is 
made between the motion and/or deformation compensated first data and the projection 
15 actually measured. In a simple case, the difference may be determined on the basis of a 
subtraction. 

Then, in step SI 5, the difference or error determined in step S14 is back- 
projected by using the motion map or motion field already used in step S12. This may 
simply be done by storing the integration weights of the individual voxels of the first 

20 image dming the forward-projection in step SI 2. These integration weights define how 
strongly the voxel contributed to, for example, the line integrals. The same weights can 
be applied after proper normalisation during the back-projection in step SI 6. This 
results in a new updated first image on the basis of the back-projected difference. Then, 
the method continues to step 817, where it is determined whether an end criterion is 

25 met or not. The end criterion may, for example, be that the iteration was performed for 
all projections of the projection data or that the differences between the projection 
actually measured and the first image are be lower predetermined threshold. In case that 
is determined in step SI 7 that the end criterion is not met (step 818), the method 
continues with step 812, where the new first image is forward projected using the 

30 motion map resulting in first data. Steps 812 to 818 may be iteratively repeated until 
the end criterion is met. In case it is detemiined in step SI 7 that the end criterion is met, 
the method continues to step SI 9, where it ends. 
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It should be noted that, as apparent to the skilled person, the above 
described technique noiay be applied to all known iterative reconstruction techniques 
known in PET, SPECT, or CT imaging, such as, for example, RAMLA, ML-EM, OS- 
ML-EM,orART. 

5 Fig. 7 depicts an exemplary embodiment of a data processing device 

according to the present invention for executing an exemplary embodiment of a method 
in accordance with the present invention. The data processing device depicted in Fig. 7 
comprises a central processing unit (CPU) or image processor 151 connected to a 
memory 152 for storing an image depicting an object of interest, such as a patient. The 

10 data processor 151 may be connected to a plurality of iaput/output network or diagnosis 
devices, such as an MR device or a CT device. The data processor may furthermore be 
connected to a display device 154, for example, a computer monitor, for displaying 
information or an image computed or adapted in the data processor 151. An operator or 
user may interact with the data processor 151 via a keyboard 155 and/or other output 

15 devices, which are not depicted in Fig. 7. 

Furthermore, via the bus system 153, it is also possible to connect the 
image processing and control processor 151 to, for example, a motion monitor, which 
monitors a motion of the object of interest. In case, for example, a lung of a patient is 
imaged, the motion sensor may be an exhalation sensor. In case the heart is imaged, the 

20 motion sensor may be an electrocardiogram (ECG). 



